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DETAILED ACTION 

1 . The Request for Continued Examination (RCE) filed on 08 October 2008 under 37 CFR 
1.53(d) based on parent Application No. 09/788,603 is acceptable and a RCE has been 
established. An action on the RCE follows. 

2. The amendments filed on 08 October 2008, submitted with the filing of the RCE have 
been received and entered. Claims 1,4-11, 13-20 and 22-29 as amended are pending in the 
application. 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S. C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

3. Claims 1, 3-4, 9-11, 13, 18-20 and 22-27 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Pinard U.S. Patent 5,898,432 and Canaday et al. U.S. Patent 6,064,387 
(hereinafter "Canaday"). 

Referring to claims 1 and 1 1 , Pinard teaches a method and system comprising a memory 
that stores associations between an activity stream and a representation element, the activity 
stream based on an activity beyond a perception of a user (for example, associating the activity 
steam of a received electronic mail message with the displayed appearance of a cursor icon, as 
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shown in Figure 4) (Pinard: column 1, lines 52-67 and column 4, lines 1 1-16); at least one 
synthesizer circuit, synthesizing a human sensible attribute of the representation element 
responsive to changes in the activity stream and the stored associations (synthesizing the 
displayed cursor icon based on changes; for example, the displayed cursor icon can be modified 
to the mail message cursor icon in order to indicate changes in the activity stream, such as arrival 
of a new electronic mail message) (Pinard: column 4, lines 11-16); presenting the synthesized 
human sensible attribute of the representation element to the user (upon the arrival of a new mail, 
the displayed appearance of the cursor is changed to be presented as a mail icon) (Pinard: column 
1, line 52-column 2, line 9); and dynamically changing the human sensible attribute of the 
representation element responsive to dynamic changes in the activity stream (the human sensible 
attribute of the representation element, i.e. the displayed form of the cursor icon dynamically 
changes as the received function changes, i.e. as the system receives a mail message) (Pinard: 
column 4, lines 5-31), wherein varying portions of a graphical user interface associated with the 
representation element are being used in informing the user of the changes in the activity stream 
(the mail message cursor icon is displayed on varying portions of the graphical user interface, i.e. 
as the user moves the cursor around on the screen, in order to inform the user of changes in the 
activity stream, i.e. the arrival of new mail (Pinard: column 1, line 52-column 2, line 9 and 
column 3, line 33 - column 4, line 27). However, Pinard fails to explicitly teach that the 
dynamically changing the human sensible attribute is gradually increasing an intensity of the 
human sensible attribute. Canaday teaches a graphical user interface that changes the human 
sensible attribute of a representation element such as an icon or cursor to represent changes in 
activity stream (the appearance of the cursor dynamically changes based on the distance between 
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the cursor and the target icons) (Canaday: column 2, lines 3-8 and column 3, lines 44-50) similar 
to that of Pinard. In addition, Canaday further teaches gradually increasing an intensity of the 
human sensible attribute (as the distance between the cursor and target icon increases, the 
intensity of the cursor, i.e. the flash rate of the cursor will increase to indicate a greater urgency) 
(Canaday: column 3, lines 44-50). It would have been obvious to one of ordinary skill in the art, 
having the teachings of Pinard and Canaday before him at the time the invention was made, to 
modify the changing of the human sensible attribute of the representation element responsive to 
changes in the activity stream of Pinard to include the gradual increase in intensity of the human 
sensible attribute based on changes in the activity stream, as taught by Canaday. One would 
have been motivated to make such a combination in order to indicate differing levels of urgency 
for the displayed indicator notiflcations in a subtle way. 

Referring to claims 4 and 13, Pinard, as modified, teach wherein the activity stream is 
information including external sensor information (alerts that are sensed from external devices 
such as telephones can be used to notify the user of important information, i.e. arrival of an 
incoming call) (Pinard: column 2, lines 17-19 and column 3, line 62 - column 4, line 27). 

Referring to claims 9 and 18, Pinard, as modified, teach the human-sensible attribute is a 
display attribute (display of an icon) (Pinard: Figures 2-5). 

Referring to claims 10 and 19, Pinard, as modified, teach the display attribute includes at 
least one of a text characteristic, a window characteristic, a desktop characteristic (displaying 
icons on the desktop) (Pinard: Figures 2-5). 
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Referring to claim 20, Pinard, as modified, teach determining a users focus of attention 
by actively sensing the user's focus of attention (user's focus of attention is sensed by the 
position of the cursor) (Pinard: column 3, lines 33-40). 

Referring to claims 22-23, Pinard, as modified, teach wherein the activity is at least one 
of a scheduled event approaching and sensor values changing (sensing the activity of a change in 
the message sent by the application program; for example, when the change of arrival of an 
email is detected, the icon is correspondingly changed) (Pinard: column 1, line 52-coIumn 2, line 
9 and column 3, line 33 - column 4, line 27). 

Referring to claims 24-25, Pinard, as modified, teach wherein the activity stream 
comprises information including at least one of external sensor information, telephone 
information, broadcast news information and pager information (alerts that are sensed from 
external devices such as telephones can be used to notify the user of important information, i.e. 
arrival of an incoming call) (Pinard: column 2, lines 17-19 and column 3, line 62 - column 4, 
line 27). 

Referring to claim 26, Pinard teaches a method comprising determining the focus of 
attention of the user (user's focus of attention is determined by the position of the cursor) 
(Pinard: column 1, lines 52-63); detecting a change in an activity stream (synthesizing the 
displayed cursor icon based on changes; for example, the displayed cursor icon can be modified 
to a fax cursor icon in order to indicate changes in the activity stream, such as arrival of a new 
fax) (Pinard: column 4, lines 11-16), the activity stream occurring outside of perception of the 
user (for example, associating the activity steam of a received electronic mail message with the 
displayed appearance of a mail message cursor icon 25 shown in Figure 4) (Pinard: column 1, 
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lines 52-67 and column 4, lines 11-16); determining a representation element associated with the 
activity stream, the representation element having human sensible attributes (the cursor is 
modified to display a representation element, i.e. a fax icon associated with the arrival of a new 
fax) (Pinard: column 4, lines 11-16); and dynamically changing the human sensible attributes 
responsive to the dynamic change in the activity stream (the human sensible attribute of the 
representation element, i.e. the displayed form of the cursor icon dynamically changes as the 
received function changes, i.e. as the system receives a fax, telephone call, etc.) (Pinard: column 
4, lines 5-31), wherein the changing of the human sensible attributes is adapted to be sensed by 
the user in the periphery of attention of the user (displaying the icon at the periphery of the 
cursor, which is the current focus of attention, i.e. attaching the icon to the cursor, as shown by 
Figures 2-5) (Pinard: column 3, lines 57-61). However, Pinard fails to explicitly teach that the 
dynamically changing the human sensible attribute is gradually increasing an intensity of the 
human sensible attribute. Canaday teaches a graphical user interface that changes the human 
sensible attribute of a representation element such as an icon or cursor to represent changes in 
activity stream (the appearance of the cursor dynamically changes based on the distance between 
the cursor and the target icons) (Canaday: column 2, lines 3-8 and column 3, lines 44-50) similar 
to that of Pinard. In addition, Canaday further teaches gradually increasing an intensity of the 
human sensible attribute (as the distance between the cursor and target icon increases, the 
intensity of the cursor, i.e. the flash rate of the cursor will increase to indicate a greater urgency) 
(Canaday: column 3, lines 44-50). It would have been obvious to one of ordinary skill in the art, 
having the teachings of Pinard and Canaday before him at the time the invention was made, to 
modify the changing of the human sensible attribute of the representation element responsive to 
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changes in the activity stream of Pinard to include the gradual increase in intensity of the human 
sensible attribute based on changes in the activity stream, as taught by Canaday. One would 
have been motivated to make such a combination in order to indicate differing levels of urgency 
for the displayed indicator notifications in a subtle way. 

Referring to claim 27, Pinard, as modified, teach wherein the human sensible attributes 
are selected from vision, sound, touch, taste and smell (displaying the icons on the screen) 
(Pinard: Figures 2-5). 

4. Claims 5-8 and 14-17 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Pinard U.S. Patent 5,898,432 and Canaday et al. U.S. Patent 6,064,387 (hereinafter "Canaday"), 
as applied to claims 1 and 1 1 above, and Tavori U.S. Patent 5,724,025. 

Referring to claims 5 and 14, Pinard and Canaday teach all of the limitations as applied to 
claims 1 and 1 1 above. However, Pinard and Canaday fail to explicitly teach that the human- 
sensible attribute is synthesized based on a selected range. Tavori teach a computer with a 
graphical display for displaying monitored information similar to that of Pinard and Canaday. In 
addition, Tavori further teaches wherein the human-sensible attribute is synthesized based on a 
selected range (a human-sensible attribute such as an alarm may be set off based on a range, i.e. 
upper and lower limit set points) (Tavori: column 2, line 46-column 3, line 15). It would have 
been obvious to one of ordinary skill in the art, having the teachings of Pinard, Canaday and 
Tavori before him at the time the invention was made, to modify the user interface for 
synthesizing the human-sensible attribute of Pinard and Canaday to include the use of a selected 
range taught by Tavori. One would have been motivated to make such a combination in order to 
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provide standardized/set limits and guidelines for when alerts should be presented to the user; the 
combination further allows the interface to be used for medical purposes facilitating the 
monitoring and displaying of measured patient information, allowing fast and accurate diagnosis 
of the patient and allowing immediate alerts of medical emergencies when alarmed conditions 
occur. 

Referring to claims 6 and 15, Pinard, as modified, teach wherein the human-sensible 
attribute is synthesized based on values outside a selected range (the human-sensible attribute of 
the alarm is set off when the monitored data exceeds, i.e. is outside of the set limits) (Tavori: 
column 2, line 46-column 3, line 15). 

Referring to claims 7 and 16, Pinard, as modified, teach wherein the activity stream has a 
value outside a predicted range of values (the monitored activity streams of the user's vital signs 
can exceed the set limits, setting off the alarm) (Tavori: column 2, line 46-column 3, line 15). 

Referring to claims 8 and 17, Pinard, as modified, teach determining the predicted range 
of values based on monitoring the activity stream (monitoring activity streams such as the user's 
vital signs to determine whether the monitored values exceed a set range) (Tavori: column 2, line 
46-column 3, line 15). 

5. Claims 28-29 are rejected under 35 U.S.C. 103(a) as being unpatentable over Pinard U.S. 
Patent 5,898,432 and Canaday et al. U.S. Patent 6,064,387 (hereinafter "Canaday"), as applied to 
claim 26 above, and Ferrel et al. U.S. Patent 5,860,073 (hereinafter "Ferrel"). 

Referring to claim 28, Pinard and Canaday teach all of the limitations as applied to claim 
26 above. However, although Pinard and Canaday teach changing the human sensible attributes. 
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Pinard and Canaday fail to explicitly applying a dynamic stylesheet to the representation 
element. Ferrel teaches a method for changing the display of an object similar to that of Pinard 
and Canaday. In addition, Ferrel further teaches applying a dynamic stylesheet to the 
representation element (the objects displayed in a document can be modified to be displayed 
differently) (Ferrel: column 3, lines 8-15 and column 27, lines 52-55). It would have been 
obvious to one of ordinary skill in the art, having the teachings of Pinard, Canaday and Ferrel 
before him at the time the invention was made, to modify the changing of the human sensible 
attributes of a displayed object of Pinard and Canaday to include the changing of attributes of 
objects via dynamic stylesheets, as taught by Ferrel. One would have been motivated to make 
such a combination in order to allow fast and efficient delivery of a plurality of formatting 
information to displayed elements. 

Referring to claim 29, Pinard, as modified, teach authoring the dynamic stylesheet 
(Ferrel: column 3, lines 45-53) including obtaining a selected activity stream from among a 
plurality of activity streams (displaying a selected activity stream, such as the arrival of a new 
mail, among a plurality of activities, including fax, telephone, etc.) (Pinard: column 1, line 52- 
column 2, line 9 and column 3, line 33 - column 4, line 27); and specifying variations to the 
human sensible attributes of the representation element responsive to changes in the selected 
activity stream (different representation elements, i.e. the mail icon, fax icon, telephone icon, etc. 
are displayed in order to inform the user of changes in the activity stream, i.e. the arrival of new 
mail, new fax, new call, etc.) (Pinard: column 1, line 52-column 2, line 9 and column 3, line 33 - 
column 4, line 27), wherein the variations in the human sensible attributes indicate, 
unobtrusively to the user, the changes in the selected activity (displaying the icon at the 
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periphery of the cursor, which is the current focus of attention, i.e. attaching the icon to the 
cursor, as shown by Figures 2-5) (Pinard: column 3, lines 57-61). 



Response to Arguments 

6. Applicanf s arguments with respect to claims 1,4-11, 13-20 and 22-29 have been 
considered but are moot in view of the new ground(s) of rejection. 



Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to TING ZHOU whose telephone number is (571)272-4058. The 
examiner can normally be reached on Monday - Friday 8:00am - 5:00pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Dennis Chow can be reached on (571) 272-7767. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an apphcation may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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